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SUMKARY 


The  purpose  of  thif',  paper  is  to  Illustrate  how 
the  techniques  of  the  theory  of  dynamic  programming 
may  be  used  to  convert  a  number  of  eigenvalue  problems, 
where  one  is  interested  only  in  maximum  or  minimum 
values,  into  problems  involving  recurrence  relations. 
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KiaKKVALUES  AND  FUNCTIONAL  EQUATIONS 


Richard  Bellman 


§1  .\  IINTRODUCTION 

ii  ^ 

'Tiie  purpoae  of  this  paper  A*  to  illustrate  how  the  techniques 


of  the  theory  of  dynamic  programming may  be  used  to  convert 
a  number  of  eigenvalue  problems,  where  one  la  interested  only  in 
maximum  or  minimum  values,  into  problems  Involving  recurrence 

relations . 

/  i 

-In  Ww  ws  she  Vi  treat  Jacobi  matrices,  some  special  types 
of  quadratic  forms  possessing  certain  features  of  regularity,  and 
finally  Stum-Llonville  problems.  The  connection  between  Stuns- 
Llouville  problems  and  dynamic  programming  has  already  been  dis¬ 
cussed  In  [2]  ,  using  an  approac£>/dif ferent  from  that  we  shall 
pres ent_httgfi>  - 

The  method  discussed  M>Pw  is  not  only  useful  for  computa¬ 
tional  purpoae* ,  but  provides  a  method  for  studying  the  analytic 
dependence  of  the  maximum  and  minimum  eigenvalues  upon  the  analytic 
structure  of  the  matrix. 


§2.  JACOBI  MATRICES* 

Let  us  consider  the  Jacfcbl  matrix 

/  b'  <4»  0 
I  & »  at 

(1)  J  -I 

V°  aN— 1  b»-I  aN-l 

aN— 1  bN 


Qtner  computational  techniques  are  treated  in  papers  of  W.  Karush, 


ytner  computational  tec 
[4]  and  C.  Lanzcos,  [p]  . 
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and  the  associated  quadratic  form 

H  N-l 

(2)  Q(x)  -  £  b  X»  ♦  2  l  Whl  • 

k»l  k-1 

Define  the  sequence  of  functions 


a) 


•n(y)  -  Max  [b„x*  +  2yxN] 
TT 


r  N  N— 1  n 

fR<y)  "  (tf  L^R  b*^  +  2yx*  +  2  k^R  Wk+lJ  , 


where  the  maximization  Is  over  the  region 

<*»  l^-1  ■ 

The  majclmum  characteristic  root  of  J  Is  clearly  fx(0). 

Let  us  now  show  that  we  can  obtain  a  recurrence  relation  con¬ 
necting  the  members  of  the  sequence  {fj^(y))  •  Write 

r  N 

(b)  fR(y)  -  Max  [bRx*  +  2yx„  +  b^xj  +  2«RVR+1 


N-l  i 

+  2r.Li  J  • 


Once  x^  has  been  chosen,  the  problem  of  choosing  the  remaining  x^ 
la  ^ulte  similar  to  the  original,  with  R  transformed  Into  R+l  and 
the  constraint  on  the  remaining  x^  taking  the  form 

N 

(<~  ) 


-L  ^  • 1  -  • 


Let  us  then  set 


(7)  xk  -  jT^x|  zk,  k  -  P.+ 1 ,  .  .  . , N  , 
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bo  that  the  constraint  01.  z, 


18  l 

k*=R+ 1 


<  ■  1 


We  then  have 


(8)  fR(y) 


Max  bnxg  ♦ 

w  R  R 


2yx« +  (1"XS)  Ll  b« 


a  2aR*RZR+l 


z  + 


K-rf+1  K  k  j  l^X* 


+  2  5 

k-R+1 


a  z,  z. 
k  k  k+ 


IJ  * 


ttuploylng  the  "principle  of  optimality,"  [l] ,  *e  obtain  the 
recurrence  relation 

(^)  fR(y)  *  ,***  bRXR  ♦  2yxR  ♦  (1_xR)fR4.i(aRxR/J  1-xr  ]  » 

^  - 

for  R  -  1,2,... ,N— 1 . 

A  Blmllar  recurrence  relation  may  be  obtained  for  the  minimum 
eigenvalue  *lth  Min  replacing  Wax. 

§5.  EXTENSIONS 

Similar  recurrence  relations,  of  more  complicated  form,  may 
be  obtained  from  the  consideration  of  matrices  of  the  form 


b  i  a  |  c  j 

( 

a i  ai  c* 
c |  a  a  b  s  as  c  s 


The  basic  sequence  is 


(2)  fn(u,v)  -  Max 


r  N  N— 1  N— 2 

l  Jr  ^  +  2  Jr  +  2  Jr 


+  2  uxR  +  2v 


*R+1  . 
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64  .  SOME  SPECIAL  CLASSED  OF  QUADRATIC  FQRMD 

Consider  the  following  three  special  classes  of  quadratic  forms 

(a)  Qi  -  (axt)8  4  ( x i  4  axa)a  4  ...  4  (xj  4  x*  4  ...  4  4  axN)*f 

(1)  (b)  Qa  ■  X?  4  (xj  4  ax*)a  4  ...  4  (Xi  4  SX*  4  ...  4  a^^Xj^)*, 

(c)  Qa  -  x?  4  (xt  4  axg)1  4  (x:  4  axa  4  (a4b)x*)a4  ... 

4  (xj  +  ax*  4  (a4b)xs  4  ...  4  (a4(N— 2  )b)xN)*  . 

For  the  first  quadratic  form,  define  the  sequence 


(2)  fR(y)  -  Max  [(y4axR)a4(y4XR4axR+ ,  )*4. . .4(y4XR4xR^14 

\x) 


.  .4Xjj__^4a-X 


N^*l  * 


N 

over  the  region  >  x£  ■  1 

k-R  * 


As  above,  we  obtain  the  recurrence  relation 

O)  fR(y)  -  Max  (y>axR)a4(l-x*)fR^1((y4XR)/jT^xa  )1  . 

xr<  1 


Recurrence  relations  of  similar  fora  may  be  obtained  for  the  other 
quadratic  forma  and  for  the  minimum  c^aracterlst lc  roots. 

Many  other  special  classes  of  quadratic  forms  can  be  constructed 
to  yield  simple  recurrence  relations  .  lYie  form 


m 


N 

k-1 


(xirV 


bk{xk-Xk-l)J 


is  discussed  in  [ >]  . 


§b  •  SIQSKVALUE  PROBLEMS 
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If  ^(x)  la  a  contlnuouo  function  over  [o,l],  uniformly 
positive  oc  that  4*x)  2  a#  >  0»  the  problem  of  determining  the 
valuea  of  >  which  yield  non— trivial  aolutlona  of 

uM  +  7\  4(x)u  -  0, 

(1) 

u(0)  -  u( 1 )  -  0, 

la  equivalent  to  the  problem  of  de termlning  the  relative  minima 
of 

(2)  J(u)  -  /  u'*  dx, 

6 

subject  to  the  constraints 

(a)  j"  4>(x)u*dx  ■  1, 

6 

l» 

(b)  u(O)  -  u(l)  -  0. 

We  shall  consider  here  only  the  absolute  minimum.  Using 
a  different  approach,  a  functional  equation  connected  with  this 
quantity  was  derived  In  [2]  .  Here  we  use  the  following  approximate 
technique.  Consider  the  problem  of  minimizing 

(•0  j  -  I  <V-V-1>*  a  • 


P-?84 

i 


subject  to  the  restrictions 

N— 1 

<a>  Vk^'1 

(5) 


k-1 

(b)  uQ  -  x,  uN  -  0. 


Set  $k  -  g£,  -  g^u^,  and  absorb  the  ^  factor,  obtaining 

the  problem  of  minimizing 


N 


(0)  J(x)  -  f  ( 


k-1 


k-1 


V  Sir  S 


k-1 


) 


subject  to 


N— 1 

(a)  |^i x* 


(7) 


(b)  xQ  -  zgo,  xN  -  0  . 


Define  the  sequence 

N  /X,.  x 

k-R  N  sk  s 


(d)  fR(«)  -  Kin  I  • 


k-1 


N 


with  x 


R— 1 


-  (J'/er  f  xf  -  1,  x„  -  0 


k^R  k  ’  " 


We  have 


(y) 


fN(z)  -  Min  (^  -  z)* 
N  x*-l  ^  SN 


N 

-  Min 


1  *  1  2 


S 


N 


nd 


g 


N 


(10)  fR(z)  -  Min 


(x)  L  '  *R 


(  g-  z)  *  C1  xR)fR>lCXR/^  fiR  J  1  *R  ) 
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